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Preliminaries 

This  presentation  is  an  outgrowth  of  an  earlier  report  "Probabilistic 
Programming  1950-1963:  An  Annotated  Bibliography"  which  has  appeared  as 
Technical  Memorandum  No.  155  of  the  Department  of  Operations  Research, 
School  of  Management,  Case  Western  Reserve  University.  The  organization, 
format,  and  rationale  for  this  document  is  drawn  from  that  of  the  former 
which  should  be  consulted  as  to  the  structural  details  of  this  summary. 

It  is  noted  in  passing  that  an  attempt  has  been  made  to  provide  the 
most  complete  and  up-to-date  reference  citations  possible.  Where  only 
partial  information  as  to  the  literature  citation  is  presented  in  the 
entry  provided,  it  represents  the  latest  available  estimate  of  the  place 
of  appearance  of  the  material  discussed  as  provided  by  its  author.  In 
most  instances  a  copy  of  the  work  can  be  approached  through  reference  to 
the  listed  alternate  source. 


The  content  of  this  memorandum  arises  as  a  specialization  of  that  of 
its  predecessor  document.  Whereas  the  former  concern  was  with  the  broad 
area  of  "probabilistic  programming",  attention  has  been  restricted  here  to 
a  mathematical  programming  problem  termed  in  the  literature  "two-stage 
linear  programming  under  uncertainty"  (and  its  varients) .  Entries  [9], 
[10],  [12],  [15],  [18],  [22],  [24],  [27],  [28],  [33],  [37],  [39],  [45], 
[53],  [57],  [60],  [63]  of  Technical  Memorandum  No.  155  summarize  the 
development  of  the  theory  on  this  problem  in  the  years  1950-1963;  the 


Intent  of  this  psper  is  to  provide  a  similar  service  for  the  years 
1964-1969.* 

An  understanding  of  this  work  rests  on  a  working  knowledge  of  tha 
techniques  of  linear  and  nonlinear  programming  and  of  the  nidlments  of 
"chance-constrained",  "stochastic",  and  "two-stage"  uncertain  linear 
programs.  Since  this  last  is  to  be  the  cohesive  thought  behind  the 
summaries  presented.  It  seems  worthwhile  to  present  a  brief  discussion 
of  the  basic  "two-stage'  formulation  used  as  the  point  of  departure  for 
this  survey.  For  a  discussion  in  greater  depth,  see  the  entries  cited 
above  or  the  articles  indexed  by  this  bibliography. 

The  Basic  Model 

Consider  the  following  analytical  construction 

Minimize  cx  +  Ey{qY(V)} 

Subject  to:  Ax  “  b 

B(V)x  +  CY(V)  -  d(V) 

X  ^  0 

where  x  is  an  n^-vector  of  variables,  Y  is  an  n2~vector  of  variables, 
c  and  q  are  n^-  and  n^-vectors  of  objective  function  coefficients, 
respectively,  A  is  an  m^x  n^  matrix,  b  is  an  mj^-vector,  B  is  an 
m^  X  nj^  matrix,  C  is  x  n2  matrix,  d  is  an  -® 

a  random  variable  assuming  values  v  in  accordance  with  some  probability 
distribution  function  F^.  In  the  given  formulation  attention  is  called 
to  the  fact  chat  B,  Y  and  d  are  functions  of  the  random  variable  V. 

A 

Articles  of  the  first  index  referenced  by  the  papers  here  reviewed  have 
been  cited  by  Che  numerical  indicator  previously  adapted,  e.g.,  the  list  abave. 

iii 


Such  problems  have  come  to  be  called  "stochastic  programs  with  recourse" 
in  the  literature.  One  possible  further  generalization  is  to  allow  the 
matrix  C  and  the  vector  q  to  be  defined  by  the  random  variable  also. 

If  C  remains  "fixed"  the  problem  is  one  of  solving  a  "stochastic  program 
with  fixed  recourse." 

An  interpretation  of  this  mathematical  model  places  in  evidence  the 
two-stage  nature  of  the  associated  decision  process.  One  is  faced  with  a 
problem  of  decision  making  in  the  face  of  a  set  of  uncertain  future  states 
of  nature.  Circumstances  are  chat  some  plan  (a  decision  x)  must  be  adopted 
Immediately  subject  to  the  situational  constraints  (Ax  =  b  and  x  2.  0) 
but  an  adjustment  decision  (Y)  may  be  adopted  later  if  compensation  for 
unforeseen  circumstances  (V)  is  required  for  successful  closure  of  the 
anticipated  program  (CY  =  d(V)  -  B(V)x).  The  program  adopted  is  to  be 
evaluated  relative  to  the  sum  of  the  cost  of  the  initial  ("first-stage") 
decision  (cx)  and  the  resulting  expected  cost  of  the  later  ("second-stage") 
decision  E^{qY(V)}. 

A  simple  example  of  this  problem  is  a  two-stage  production  planning 
process  in  the  face  of  uncertain  demands.  Production  is  undertaken  in  the 
first  period  as  reflected  by  the  technology  matrix  A  and  the  quantity  of 
goods  produced  b  and  the  costs  of  production  c.  Demands  occur  in  the 
second  period  in  accordance  with  a  given  distribution  with  any 
discrepancies  between  first-stage  usable  production  B(V)x  and  the  realized 
demands  d(V)  being  resolved  through  recourse  to  a  compensatory  decision 
Y(V)  with  associated  costs  q. 
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is  a  convex  function  of  the  first  stage  decision  variables  for  any  fixed 
value  of  the  right-hand-side  coefficients.  The  main  result  states  that 
the  expected  cost  obtained  by  implementing  the  decision  defined  by  solving 
the  problem  obtained  by  replacing  the  stochastic  right-hand-side  coefficients 
by  their  expectations  is  greater  than  the  expected  cost  obtained  by  solving 
the  two-stage  problem.  The  latter  is  shown  to  be  greater  than  the  expected 
cost  which  would  obtain  if  observation  of  the  stochastic  right-hand-side  co¬ 
efficients  were  made  prior  to  making  the  "first-stage"  decision.  Tfiis 
last,  in  turn,  is  shown  to  be  greater  than  the  cost  which  would  result  from 
the  solution  of  the  deterministic  program  in  which  the  right-hand-side 
coefficients  are  replaced  by  their  expectations.  An  upper  and  lower  bound 
to  the  two-stage  stochastic  problem  objective  is  given  in  terms  of  -he 
solutions  for  two  deterministic  problems  of  the  same  size. 

References:  [9],  [10],  [25],  [27]. 

Alternates:  0.  L.  Mangasarlan  and  J.  B.  Rosen,  "Inequalities  for  Stochastic 
Nonlinear  Programming  Problems,"  Recent  Advances  in  Mathematical 
Programming ,  R.  L.  Graves  and  P.  Wolfe,  eds.,  McGraw-Hill, 

New  York,  1963,  p.  123  (Abstract).  Also  under  the  same  authors 
and  title  as  Report  P  1127,  Shell  Oil  Development  Company, 
Emeryville,  California. 

Referenced  by:  [lA],  [3A],  [16A],  [17A],  [27A]  ,  [28A],  [32A],  [38A],  [47A] . 
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[3A]  Bui  Trong  Lieu,  "On  a  Problem  of  Convexity  and  its  Application  to 

Nonlinear  Stochastic  Programming,"  Journal  of  Mathematical  Analysis 
and  Applications,  Vol.  8,  No.  2,  April,  1964,  pp.  177-137. 

This  paper  in  one  sense  is  a  review  and  restatement  of  results 
contained  in  the  references  cited.  It,  at  the  same  time,  is  an  extension 
of  the  same  results  by  virtue  of  the  mathematical  preciseness  of  the 
presentation  which  introduces  a  deeper  level  of  abstraction  into  the 
discussion.  This  same  depth  of  abstraction  renders  the  discussion 
difficult  to  follow  at  a  first  reading. 

Two  subdivisions,  one  covering  a  deterministic  description  and  the 
other  a  random  model,  organize  the  results.  The  presentation  is  such  that 
Che  deterministic  results  carry  through  quite  nicely  to  the  random 
characterization.  The  usual  inequalities  applicable  to  the  objective  form 
of  a  two-stage  uncertain  nonlinear  program  are  developed  on  Che  basis  of 
given  convexity  assumptions  and  proofs. 

References:  [27],  [37],  [45],  [53],  [2A]. 

Alternates : 

Referenced  by:  [16A],  [32A]. 
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[4A]  David  KShler  and  Roger  Wets,  "Programming  Under  Uncertainty:  An 

Experimental  Code  for  the  'Complete'  Problem,"  Operations  Research 
Center,  University  of  California,  Berkeley,  ORC  64-15 .  July,  1964. 


The  topic  of  this  report  is,  as  its  title  suggests,  the  presentation  of 
a  computer  code  for  a  special  form  of  the  two-stage  linear  progreimmlng  under 
uncertainty  problem.  In  particular,  it  is  assumed  chat  all  decision  vectors 
feasible  for  the  first-stage  constraint  set  will  be  feasible  for  the  second- 
stage  problem  with  descrepancles  by  definition  equaling  the  second-stage 
decision  variable.  The  algorithm  outlined  assumes  a  continuously  distributed 
right-hand-side  vector  for  the  second-stage  constral^nt  set  and  uses  successive 
supporting  hyperplanes  to  the  objective  form  to  define  directions  of  descent 
which  yield  a  sequence  of  solutions  converging  to  the  optimum. 

A  brief  statement  of  the  problem  is  given  with  the  theoretical  justification 
of  the  equations  used  in  the  algorithm  left  to  the  cited  reference.  Two 
general  block  diagrams  Indicative  of  the  program  structure  accompany  the 
user  write  up  presented.  In  the  latter,  sufficient  detail  is  given  so  that 
a  person  having  a  source  deck  for  the  program  could  successfully  run  some 
sample  problems.  The  first  pages  of  output  from  one  test  problem  which  was 
Investlr.ated  is  Included  to  Illustrate  the  data  format,  but  no  source  deck 
listing  is  in  evidence.  It  should  be  noted  that  the  program  as  developed 
was  written  in  FORTRAN  IV  and  is  compatible  with  the  IBSYS  Monitor  for  the 
IBM  7000  series  computers. 

References:  [15],  [llAj. 

Alternates:  David  Kohler  and  Roger  Wets,  "Programming  Under  Uncertainty:  An 
Experimental  Code  for  the  Complete  Problem,"  Boeing  Scientific 
Research  Laboratories ,  Document  Dl-82-0391,  (Mathematics 
Research  Laboratories,  Mathematical  Note  No.  378),  December,  1964. 

Referenced  by:  [llA],  [27A],  [44A]. 
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[5A]  Wlodzimierz  Szwarc,  "The  Transportation  Problem  with  Stochastic 
Demand,"  Management  Science,  Vol.  11,  No.  1,  September,  1964, 
pp.  33-50. 

The  transportation  problems  considered  in  this  paper  are  assumed  to 
have  consumer  requirements  which  are  described  by  random  variables  having 
bounded  supports  for  their  marginal  distribution  functions.  It  is 
assumed  that  the  distribution  functions  can  be  approximated  satisfactorily 
by  step  functions,  and  that  the  appropriate  objective  is  to  minimize  the 
cost  of  allocating  supplies  to  outlets  plus  the  sum  of  the  expected 
(piece-wise  linear)  cost  due  to  undeisupply  or  oversupply  at  each  destination. 
An  approximating  deterministic  linear  program  is  developed  through  use  of 
a  piece-wise  linear  approximation  to  t'tie  nonlinear  objective  form.  It 
incorporates  auxiliary  variables  with  upper  bounds.  A  solution  procedure 
is  presented  and  used  to  solve  an  example  problem. 

References:  [15],  [50],  [8A]. 

Alternates : 


Referenced  by: 


[6A]  G,  Hadley,  "Stochastic  Programming,"  Nonlinear  and  Dynamic  Programming, 
Chapter  5,  Addison-Wesley  Publishing  Company,  Inc.,  Reading, 
Massachusetts,  1964,  pp.  158-184. 

This  chapter  presents  an  operational  discussion  of  stochastic 
prograniming  problems.  That  is,  several  examples  are  discursed  in  order  to 
illustrate  the  formulation  procedure  for  such  problems  ar.d  to  point  out 
the  difficulties  which  complicate  their  solutions.  In  the  main  the  discussion 
centers  on  problems  of  the  "two-stage"  variety  although  "chance-constrained" 
and  "stochastic"  formulations  are  touched  upon. 

"Nonsequential  decision"  stochastic  programming  problems  and  "sequential 
decision"  stochastic  programming  problems  is  the  basic  dichotomy  adopted. 
Fundamentally,  this  categorization  corresponds  to  considering  "two-stage" 
and  "multi-stage"  linear  programming  under  uncertainty  problems.  Under  the 
first  category  an  inventory  problem,  a  "knapsack"  problem,  and  three 
allocation* type  problems  (a  transportation  problem,  a  problem  of  allocation 
of  aircraft  to  routes,  and  a  production  scheduling  problem)  are  formulated 
and  reduced  to  their  equivalent  convex  programs.  In  each  case  random 
variables  appear  only  in  the  right-hand-side  requirements  vector.  A  solution 
procedure  is  proposed  which  uses  a  polygonal  approximation  to  the  convex 
objective  and  allows  use  of  the  decomposition  algorithm  for  linear  programs 
to  achieve  a  solution.  An  n-period  inventory  problem  is  discussed  at  length 
to  exemplify  a  sequential  decision  stochastic  programming  problem.  It  is 
acknowledged  that  in  the  main  such  problems  are  difficult  to  solve.  Dynamic 
programming  is  suggested  as  a  solution  technique  applicable  for  the 
solution  of  a  certain  subclass  of  this  type  of  problem. 


8 


"Two-stage"  stochastic  problems  with  random  variables  appearing  In 
the  technological  coet f icients ,  the  "expected  cost  ol  uncertainty",  the 
propriety  of  replacing  the  random  variables  by  their  expectations,  and 
the  problem  of  determining  the  a  posteriori  distribution  of  the  optimum 
of  a  stochastic  linear  program  a  prion  are  all  taken  up  briefly  to 
round  out  the  discussion. 

References:  [5],  [9],  [10],  [11],  [li]  ,  [15],  [IS],  [19],  [20],  [26], 

[27],  [29],  [31],  [36]. 

Alternates : 

Referenced  by;  [38A] 
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[7aJ  M.  losifescu  and  R,  Theodorescu,  "Linear  Programming  Under 

Uncertainty,"  Colloquium  on  Applications  of  Mathematics  to 
Economics ,  Andras  Pr4kopa,  ed.,  Akad^miai  Kiad6,  Budapest, 

19C5,  pp.  133-139= 

This  paper  is  a  survey  of  results  on  stochastic  linear  programming  placed 
in  a  decision  making  context.  Results  from  several  previous  papers  by  the 
same  authors  arc  quoted  as  a  part  of  the  review.  Some  question  arises  as  to 
the  appropriateness  of  including  this  paper  in  a  bibliography  on  "two-stage" 
programming  as  the  approach  adopted  is  more  consistent  with  the  philosophy 
of  "stochastic  programming."  Perhaps  the  best  justification  in  this  regard 
(other  than  the  fact  that  the  approach  adopted  is  "interesting")  is  that 
the  discussion  considers  uncertain  linear  programs  in  a  two-person  game 
theoretic  sense.  Incorporation  of  the  "payoff  matrix"  through  use  of  a 
"loss  function"  into  Che  linear  objective  form  (as  is  done)  will  permit  the 
problems  discussed  to  be  cast  In  the  form  of  two-stage  linear  programming 
under  uncertainty  problems  (which  is  not  done). 

This  paper  opens  with  some  observations  on  the  solution  sets  for 
stochastic  linear  programs =  One  comment  on  the  containment  of  one  solution 
set  within  another  has  not  appeared  elsewhere.  The  next  section  discusses 
linear  programs  under  combinations  of  "risk”  and  "uncertainty"  placing 
emphasis  on  the  aforementioned  game  theoretic  interpretation.  The  latter 
portion  of  the  discussion  relates  the  subject  formulation  to  the  "statistical 
decision  theory"  approach  to  decision  making  under  uncertainty.  The  abstract 
probabilistic  structure  introduced  to  characterize  the  situations  presented 
is  well  thought  out  and  is  one  cf  the  better  definitions  which  have  appeared. 
References:  [AS],  [52]. 

Alternates:  This  entry  was  located  by  reference  to  a  preliminary  version  of  a 

"Bibliography  on  Programming  Under  Risk,"  supplied  by 
Mr.  Douglas  V.  Smith,  Harvard  University  Center  for  Population 
Studies,  22  Plympton  Street,  Cambridge,  Massachusetts  02138. 

[52]  is  tne  closest  equivalent  to  the  tenth  reference  of  this 
paper  that  has  been  abstracted  in  this  series  to  date. 

Referenced  by: 
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[8A]  A.  Charnes,  W.  W.  Cooper  and  G.  L  Thompson,  "Constrained  Generalized 
Medians  and  Hypermedians  as  Deterministic  Equivalents  for  Tvo-Stage 
Linear  Programs  Under  Uncertainty,"  Management  Science,  Vol.  12, 

No.  1,  September,  1965,  pp.  83-112. 

This  paper  describes  an  equivalent  formulation  or  the  usual  statement 
of  the  two-stage  linear  programming  under  uncertainty  problem  in  which  the 
second-stage  constraints  are  incorporated  into  the  program  objective 
functional.  This  is  made  possible  by  two  observations.  First,  it  is 
observed  that  the  second-stage  constraints  are  definitional  in  nature  in 
that  they  only  serve  to  define  the  nature  of  the  decision  variables  to  be 
Included  in  the  objective  functional.  Second,  it  is  noted  that  the  second- 
stage  problem  solution  as  a  function  of  the  first-stage  decision  variable 
and  the  stochastic  right -hand-side  vector  can  be  used  to  replace  the  second- 
stage  decision  variables  appearing  in  the  objective  functional.  The  result 
is  a  completely  equivalent  formulation  involving  the  first-stage  constraints, 
the  first-stage  decision  variables,  and  an  objective  functional  incorporating 
the  first  absolute  moments  of  the  distribution  of  the  right-hand-side  vector 
with  respect  to  the  first-stage  decision  variables.  These  last,  in  view  of 
the  property  of  distribution  functions  that  the  first  absolute  moment  becomes 
a  minimum  when  the  moment  point  is  the  median  of  the  distribution,  can  be 
used  to  simplify  the  optimization  required  with  respect  to  the  first  stage 
decision  variables.  Numerous  examples  are  given  at  each  step  of  the 
development  which  motivate  the  theory  presented  and  make  this  an 
exceptionally  readible  paper. 

References:  [5],  [7],  [8],  ^9],  [10],  [12],  [14],  [15],  [18],  [19],  [20], 
[23],  [24],  [26],  [27],  [28],  [29],  [30],  [31],  [33],  [37], 

[38],  [39],  [41],  [42],  [43],  [50],  [53],  [55]. 
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Alternates : 


Referenced 


A.  Chames ,  W.  W.  Cooper,  and  G.  L.  Thompson,  "Constrained 
Generalized  Medians  and  Linear  Programming  Under  Uncertainty," 
ON'R  Research  Memorandum  No :  9,  July  6,  1961,  Evanston,  Ill., 
Northwestern  University,  The  Technological  Institute  -  ONR 
Research  Project  on  Temporal  Planning  and  Management  Decision 
Under  Risk  and  Uncertainty  and  Pittsburgh,  Carnegie  Institute 
of  Technology,  Graduate  School  of  Industrial  Administration  - 
ONR  Research  Project  on  Planning  and  Control  of  Industrial 
Operations.  Also  by  the  same  authors  and  under  the  same  title 
as  ONR  Research  Memorandum  No.  41,  July  6,  1961,  a-td  again  as 
"Chance-Constrained  Studies  for  Linear  Programming  Under 
Uncertainty,  Part  One;  Constrained  Generalized  Medians  and 
Two-Stage  Problems  with  General  Linear  Structure,"  ONR  Research 
Memorandum  No.  106,  December,  1962,  and  as  "Chance  Constrained 
Studies  for  Linear  Programming  Under  Uncertainty,  I.,"  ONR 
Research  Memorandum  120,  July  196A. 

by:  [50],  [58],  [5A],  (22A] ,  i25A],  [26A] ,  [27A],  [29A],  [30A]  , 
[31A],  [37A],  [46A]. 
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[9A]  A.  C.  Williams,  "On  Stochascic  Linear  Programming,"  Journal  of  the 
Society  of  Industrial  and  Applied  Mathematics,  Vol.  13,  No.  4, 
December,  1965,  pp.  927-940. 


Linear  programs  in  which  the  inhom.ogeneous  tern  (the  right  hand  side) 
of  the  constraining  relations  are  random  variables  and  for  which  the 
objective  functional  is  the  expectation  of  the  usual  linear  form  augmented 
by  a  nonlinear  term  (which  incor poi.atca  woiisiueiation  of  discrepancies 
between  programmed  supply  and  demand)  are  discussed.  The  problem  covered 
is  therefore  a  special  case  of  the  "two-stage  linear  programming  under 
uncertainty"  formulation  for  stochascic  linear  programs. 


Several  Theorems  and  Lemmas  are  presented  which  define  necessary  and 
sufficient  conditions  for  program  feasibility  and  characterize  solutions 
for  the  subclass  of  two- stage  problems  defined  by  the  assumptions  of  the 
subject  formulation.  The  saddle  point  conditions  of  Kuhn  and  Tucker  and 
the  theory  of  duality  for  linear  programs  provide  the  foundation  for  the 
analysis.  The  treatment  given  is  theoretical  and  quite  comprehensive  for 
the  problem  type  considered. 

References:  [24],  [28],  [37],  [45],  [57],  [60],  [26A]. 

Alternates;  A.  C.  Williams,  "Orrata:  On  Stochastic  Linear  Programming," 
Journal  of  t he  Soelaty  of  Industrial  and  Applied  Mathematics , 
Vol.  15,  No.  1,  January,  1967,  p.  228,  makes  one  small 
correction  to  this  article.  This  was  also  pointed  out  in 
A.  Chames ,  M.  J.  L.  Kirby,  and  W.  M.  Raike,  "On  a  Special 
Class  of  Constrained  Generalized  Median  Problems,"  The 
Technological  Institute,  Northwestern  University,  Evanston,  Ill. 
Systems  Research  Memorandum  No.  155,  April,  1966. 

Referenced  by:  (12A]  ,  [13A],  [20A],  [21a].  [24a],  [25A],  [26A),  [28A],  [29A] 
[38A],  [46A],  [47A]. 
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[10a]  R.  J.-B.  WeCs,  "f’rogranuiiing  Under  Uncertainty:  The  Equivalent 

Convex  Program,"  Journal  or  the  Society  ot  Industrial  and  Applied 
Mathematics .  Vol.  14^  No.  1,  January,  1966,  pp.  89-105. 


This  paper  considera  the  general  two-stage  linear  program  under 
uncertainty  problem.  The  feasible  solution  sets  for  the  first  and 
second  stage  problems  are  shown  to  be  convex.  Farka's  lemma  is  applied 
to  produce  a  feasibility  test  for  a  given  trial  solution  which  apparently 
could  be  used  as  the  basis  of  a  solution  algorithm  by  virtue  of  the  fact 
that  it  reduces  the  sec  of  feasible  solutions  which  must  be  searched  for 
the  optimum.  An  equivalent  convex  program  for  the  two-stage  uncertain 
linear  program  is  developed  and  several  propositions  detailing  its 
properties  are  discussed.  Necessary  and  sufticient  conditions  for 
optimality  of  a  given  solution  are  also  described. 


Examples  in  the  form  of  special  cases  of  the  general  two-stage 
problem  are  interspersed  throughout  the  text.  These  are  used  to  illustrate 
the  main  propositions  and  suggest  solution  procedures.  A  mathematical 
appendix  contains  a  statement  of  the  "well-known"  propositions  of  linear 
and  convex  programming  which  need  be  invoked  for  the  proofs  of  the  paper. 


References:  [37],  [llA]. 

Alternates:  Roger  Jean-Baptiste  Robert  Wets,  "Programming  Under  Uncertainty," 
Ph.D.  Thesis  in  Engineering  Science,  University  of  California, 
Berkeley,  1965.  Also,  Roger  Wets,  "Programming  Under  Uncertainty; 
The  Equivalent  Convex  Program,"  Boeing  Scientific  Research 
Laboratories,  Document  Dl-82-0411  (Mathematics  Research  Laboratory, 
Mathematical  Note  No.  392),  February,  1965. 

Referenced  by:  [12A],  [15A],  [18A],  [i9A],  [20A],  [22A],  [24A],  [25Aj,  [26.A], 

[27a],  [28A],  [29A],  [31A],  [32A],  [34A],  [35Aj,  [36A],  (42A], 

[  45a]  ,  [  46A] .. 


[IIA]  Roger  Wets,  "Programming  Under  Uncertainty:  The  Complete  Problem," 
Zeltschrlft  fur  Wahrscheinllch keicstheor le  und  Varwandte  Geblete , 
Vol.  4,  No.  4,  February,  1966,  pp,  316-339. 

The  subject  of  this  paper  is  a  special  form  of  the  two-stage  linear 
program  under  uncertainty  in  which  any  discrepancies  resulting  in  a  second 
stage  decision  problem  are  resolved  by  simply  adding  or  subtracting 
resource  units  as  necessary,  i.e.,  every  decision  satisfying  the  "fixed" 
first-stage  constraints  is  automatically  feasible  for  the  second-stage 
problem.  In  particular ,  the  form  of  the  problem  is  such  that  the  second- 
stage  transformation  matrix  is  always  a  unit  matrix. 

The  first  section  of  the  report  demonstrates  the  existence  of  an 
equivalent  separable  convex  program,  for  the  underlying  stochastic  program. 
The  properties  of  the  constituent  functions  comprising  the  separable 
objective  form  are  discussed  in  some  detail.  Two  separable  convex 
prograniming  algorithms  are  suggested  as  applicable  solution  techniques. 

The  second  section  discusses  special  instances  by  assuming  particular 
distribution  functions  for  the  program  random  variables.  It  is  shovjn  that 
for  finitely  distributed  right-hand-side  random  variables  the  equivalent 
convex  program  becomes  a  linear  program  with  upper  bounds  on  the  decision 
variables.  For  a  uniform  distribution  a  quadratic  program  is  established; 
for  an  exponential  distribution  an  approximating  convex  program  is  given; 
and  for  continuous  distribution  functions  an  approximating  convex  program 
based  upon  a  series  of  uniform  distributions  is  suggested. 
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The  third  section  suggests  a  solution  algorithm  for  the  complete 
problem  in  ;he  case  of  a  continuously  distributed  right-hand-side 
coefficient  random  variable.  The  basis  of  the  algorithm  is  the  solution 
of  a  series  of  linear  programs  incorporating  consideration  of  approximating 
hyperplanes  to  the  complete  problem  convex  objective  functional  as  objective 
forms  to  generate  successive  trial  solutions. 


References:  [15],  [24],  [39],  [63],  [4A].  [18A] 

Alternates:  Roger  Jean- Bepciste  Robert  Wets,  "Programming  Under  Uncertainty," 
Fh.D.  Thesis  in  Engineering  Science,  University  of  California, 
Berkeley,  1965.  Also,  Roger  Wets,  "Progrananing  Under  Uncertainty 
The  Complete  Problem,"  Boeing  Scientific  Research  Laboratories, 
Docutiient  Dl-82  0379  fMathematics  Research  Laboratory,  Mathematica 
Kota  No.  370),  October,  1964. 

Referenced  by;  [4A],  [lOA],  [12a],  [18a],  [19A],  [20A] ,  [21A],  [22A],  [25A], 
[26A].  [27A],  [28A],  (29A],  [30A],  [34A],  [36A],  [42A],  [44A], 
[ASA],  [46A],  [47A]. 


[12A]  Richard  Vau  Slyke  and  Roger  l/eta ,  "Progtamming  Under  Uncertainty 
and  Stochastic  Optimal  Control,"  Journal  ot  the  Society  of 
Industrial  and  Applied  Mathematics  an  Control,  Vol.  4,  No.  1, 
February,  1966,  pp .  179-193. 


The  first  two  sections  of  tins  paper  are  taken  up  with  a  restatement 
of  tVie  two-stage  linear  programming  under  uncertainty  problem  in  e  abstract 

mathematical  structure  which  relates  to  Che  stochastic  optimal  c 
problem  formulation.  The  third  section  first  considers  a  theory  of  duality 
for  the  abstract  structure  developed  to  describe  the  uncertain  programming 
problem.  The  statements  and  proofs  are  reminiscent  of  those  characterizing 
the  standard  deterministic  linear  programming  duality  formulation.  For 
the  most  part,  the  proofs  are  somewhat  intuitively  presented.  In  the  second 
part  of  the  section  it  is  demonstrated  chat  the  duality  concept  developed  is 
consistent  with  linear  programming  duality  and  an  application  to  a  linear 
control  problem  discussed.  In  the  latter  Instance  the  equivalence  of  the 
duality  theory  derived  description  and  the  maximum  principle  description  is 
indicated . 

References;  [10],  [37],  [53],  [60],  [9A] ,  [lOA],  [llA], 

Alternates:  Richard  Van  Slyke  and  Roger  Wets,  "Programming  Under  Uncertainty 
and  Stochastic  Optimal  Control,"  Boeing  Scientific  Research 
Laboratories,  Document  D1-82-0429  (Mathematics  Research 
Laboratory,  Mathematical  Note  No.  405),  April,  1965. 


Referenced  by:  [15A],  [26A],  [28A] 


[13A]  A.  C.  Williams,  "Approximation  Formulas  for  Stochastic  Linear 

Prog r amiu Ing , "  Journal  of  the  Society  of  Industrial  and  Applied 
Mathematics ,  Vol.  14,  No.  4,  July,  1966,  pp.  668-677. 

The  main  purpose  of  this  paper  is  to  present  a  result  which  limits  the 
error  experienced  in  the  value  of  the  objective  functional  if  a  special 
two  stage  linear  program  under  uncertainty  is  solved  approximately  using 
a  certainty  equivalent  estimate  for  the  right-hand-side  random  vector. 

The  results  presented  are  valid  tor  any  estimate,  including  replacing  the 
random  vector  by  its  expectation.  Monltonicity  and  differentiability 
properties  of  the  error  term  described  are  detailed  and  a  suggestion  as  to 
a  method  for  generating  successively  better  estimates  is  given.  A  simple 
example  illustrates  the  nature  of  the  comparisons  obtainable  between  the 
approximate  optimal  objective  function  value  and  the  true  optimum. 

References:  [10],  [27],  [34],  [60],  [9A]. 

Alternates : 

Referenced  by:  [20A],  [21A],  [25A],  [28A],  [29A],  [38A],  [44A],  [47A] . 
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[14a]  Robert  Wilson,  "On  Programming  Under  Uncertainty,"  Operations 
Research ,  Vol.  14,  No.  4,  July-August,  1966,  pp.  652-657. 

This  short  paper  discusses  two  stage  uncertain  linear  programs  in 
which  the  random  right -hand- side  vector  is  normally  distributed.  The 
Kuhn-Tucker  conditions  are  used  to  develop  a  dual  problem  from  the 
Lagrangian  saddle-point  formulation  of  the  problem  originally  stated. 

An  application  of  the  dual  formulation  to  the  derivation  of  an  optimal 
sampling  plan  in  the  case  of  unknown  but  a  priori  estimatible  means  and 
variances  of  the  marginal  distributions  of  the  random  right-hand-side 
vector  coefficients  is  given. 

References:  [24],  [28],  [63]. 

Alternates : 


Referenced  by:  [21A],  [29A] ,  [47A] 
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[15A]  Roger  Wets,  "Progranunlng  Under  Uncertainty:  The  Solution  Set," 
Journal  of  the  Soc iety  of  Industrial  and  Applied  Mathematics , 
Vol.  14,  No.  5,  September,  1966,  pp.  1143-1151. 

This  pt.  er  is  a  continuation  of  an  earlier  one  in  which  it  was  shown 
that  the  solution  set  of  the  general  two-stage  linear  program  under 
uncertainty  is  a  convex  set-  The  main  result  of  this  paper  is  to  show 
that  the  solution  set  is  not  only  convex  but  also  polyhedral.  It  is 
also  shown  that  the  equivalent  convex  program  of  a  multi-stage  linear 
programming  under  uncertainty  problem  (and  therefore  a  fortorl  for  the 
two-stage  equivalent)  is  that  of  extremizing  a  convex  function  subject 
to  a  set  of  linear  constraints.  The  method  of  proof  is  through 
geometric  construction  and  intuitively  quite  appealing. 


References:  [58],  [63],  [lOA],  [12.A]. 

Alternates:  Roger  Wets,  "Programming  Under  Ur\cer tainty :  The  Solution  Set," 
Boeing  Scientific  Research  Laboratories,  Document  Dl-82-0464 
(Mathematics  Research  Laboratory,  Mathematical  Note  No.  424), 
August,  1965 _ 


Referenced  by:  [20A],  [23A],  [24A],  [26A],  [27A],  [35A],  [42A],  [46A]. 
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[ 16A]  Bui  Trong  Lieu,  'A  Study  of  Some  inequalities  for  Nonlinear 

Stochastic  Programming,"  Nonlinear  Programming,  Chapter  10, 

J.  Abadie,  ed.,  North  -Holland  Publishing  Company,  Amsterdam, 
and  John  Wiley  &  Sons,  Inc.  (Interscience  Publishers  Division), 
New  York,  1967,  pp.  249-258. 


This  article  is  a  rewrite  and  restatement  of  results  presented  by  the 
author  in  two  previous  papers  cited  as  references.  Although  some  proofs 
are  given,  other  results  are  quoted  only.  The  usual  inequalities  applicable 
to  the  objective  form  of  a  two-stage  uncertain  nonlinear  program  are  developed 
on  the  basis  of  suitable  convexity  and  quasi-convexity  assumptions  and  proofs. 


References:  [27],  [37],  [45],  [53],  [2A] ,  [3A] 

Alternates : 

Referenced  by:  [32A] 
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[17A]  J.  Vessels,  "Stochastic  Progragnnlng. "  Statistics  Neerlandlca , 

Vol.  21,  No.  1,  1967,  pp.  39-53. 

This  article  is  a  survey  and  introduction  to  stochastic  linear 
program.-^ing  problems.  Although  the  presentation  is  quite  general,  a 
strong  tie  to  two-stage  uncertain  linear  programming  problems  is  in 
evidence  by  virtue  of  the  discussion  on  loss  functions  and  their  relation 
to  the  two-stage  formulations  in  the  cited  references.  A  game  theoretic 
interpretation  in  which  a  decision-maker  has  to  determine  a  pure  strategy 
given  the  probability -distribution  of  strategies  of  one  other  player 
(nature)  is  used  in  the  presentation.  The  pay-off  function  for  the  first 
player  is  assumed  to  be  dependent  on  the  realized  value  of  the  criterion 
and  appropriate  evaluation  of  constraint  discrepancies.  Several  alternative 
evaluation-functions  are  proposed,  discussed,  and  used  as  a  basis  for 
illustrative  examples.  These  also  serve  to  point  up  the  correspondence 
which  exists  between  the  "two-stage"  and  "chance-constrained"  probabilistic 
programming  problem  formulations.  An  appendix  relates  the  pay-off  function 
of  the  formulations  discussed  to  the  preference  function  concepts  of  the 
economic  theory  of  utility. 

References:  19],  [26],  [27],  [28],  [37],  [43],  [45],  [50],  [54],  [55],  [62], 
[63],  [lA],  [2A]. 

Alternates : 

Referenced  by: 
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[18a]  M.  El-Agizy,  "Tvo-Scage  Programming  Under  Uncercainty  with  Discrete 
Distribution  Function,"  Operations  Research,  Vol.  15,  No.  1, 

January -February  ,  1967,  pp.  55-70. 

Two-stage  stochastic  linear  programs  in  which  the  second-stage  decision 
variable  constraint  matrix  can  be  partitioned  into  a  positive  identity 
matrix  and  its  corresponding  negative  and  in  which  the  stochastic  right-hanc- 
side  vector  has  a  discrete  distribution  are  discussed  in  this  paper. 

Equivalent  deterministic  programs  ate  developed  which  produce  the  conclusion 
that  only  the  "marginal"  distributions  ot  the  right-hand-side  stochastic 
vector,  i.e.,  the  distributions  of  the  iiiuividual  components,  are  necessary 
to  Che  problem  solution.  Tnu.s  complete  information  as  to  the  distribution 
of  the  .stochastic  right-hand-side  vector  would  be  somewhat  redundant  relative 
to  the  application  sought. 

The  deterministic  equivalent  developed  assumes  e  form  of  an  equivalent 
linear  program  with  upper  bounded  decision  variables.  Optimality  conditions 
are  developed  which,  by  virtue  of  a  natural  ordering  on  the  relative  cost 
coefficients  of  the  decision  variables,  could  be  used  to  produce  a  solution 
algorithm  requiring  substantially  less  computational  effort  than  if  the 
standacd  simplex  technique  was  applied  to  the  problem.  No  computational 
results  are  presented,  but  three  example  situations  -  a  stochastic  Htcchcock- 
Koopman's  transportation  problem,  a  production-inventory  problem  under 
uncerC'  a  demand,  and  a  stochastic  Leontief  production  model  -  are  defined 
and  cast  in  the  form  of  their  corresponding  i eterministic  equivalents. 

References:  [3],  [9],  [10],  [15],  [24],  [37],  [60],  [63],  [lOA],  [llA] ,  [18A]. 

Alternates:  Moscafa  El-Agizy,  "Programming  U'-’er  Uncertainty  with  Discrete  D.F.," 
Operations  Research  Center,  Ur.  v  jity  of  California,  Berkeley, 

ORC  (  -13 ,  22  July  1964.  Also  '.ostafa  Mohamed  Nabih  El-Agizy, 
"Multistage  Programming  Under  Uncertainty,"  Ph.D.  Thesis, 

Department  of  Industrial  Engineering,  University  of  California, 
Berkeley,  January,  1965. 

Referenced  by:  [63],  [llA] ,  [iOA],  [28A] ,  [44a],  [46A] . 
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[19A1  William  H.  Evers,  "A  New  Model  tor  Stochastic  linear  Programming," 
Management  Science,  Vol.  13,  No.  9,  May,  1967,  pp.  680-693. 

This  paper  discusses  the  problem  ot  stochastic  linear  programming  in 
relation  to  a  specific  application.  The  stochastic  problem  of  charging  a 
rnetal  melting  furnace  is  reduced  to  a  deterministic  problem  by  defining 
additional  terms  to  be  incorporated  into  the  stochastic  program  objective 
functional.  The  terms  added  are  chosen  to  reflect  the  application  discussed. 

The  deterministic  program  given  is  thus  a  substitute  for  the  usual 
formulation  for  a  particular  application  not  a  theoretical  equivalent 
applicable  CO  the  general  stochastic  programming  formulation.  The  exposition 
given  is  explanatory  and  descriptive  rather  than  theoretically  definitive. 

References:  (5j ,  [8j ,  [9],  [10],  [14j,  [15],  [18J,  [19],  [24], ^(26),  [27], 

[28],  [30],  [37],  [43],  [45],  [53],  [54],  [55],  [60],  [lOA],  [llA]. 

Alternates:  W.  Evers,  "A  New  Model  for  Stochastic  Linear  Programming," 

IBM  0_.R.  Report  No.  FSC67-0017,  C.E.S.  Rockville,  Maryland, 

August,  1966,  135  pages.  ‘ 

Referenced  by:  [22AJ,  [25a]. 
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[20a)  Shailendra  C.  Paiikh,  ''Generalized  Stocha&cic  Programs  with 

Deterministic  Recourse,"  Operations  Research  Center,  University 
of  California,  Berkeley,  ORC  67-27,  July,  1967. 

The  model  discussed  in  this  paper  :.s  an  extension  of  the  usual  two- 
stage  linear  programming  under  uncertainty  structuie-  Effectively  a 
"third-stage"  set  of  linear  constraints  are  added  which  incorporate 
consideration  of  the  deterministic  first-stage  decision  variables  and  the 
second-stage  decision  variables  (which  depend  on  the  observation  or  the 
outcome  of  some  random  process).  An  additional  set  of  decision  variables 
IS  introduced  so  as  to  allow  adjustments  in  the  final  sec  of  linear 
relations  so  as  to  achieve  their  equality  with  the  zero  vector.  The 
objective  of  the  problem  is  to  select  the  first-stage  decision  so  as  to 
minimize  the  cost  of  making  that  decision  plus  the  cost  expected  due  to 
the  "forced"  second-stage  decision  and  the  "compensatory"  third-stage 
decision.  One  type  of  problem  whicfi  may  be  cast  in  these  terms  is  that 
in  which  a  commitment  is  made  in  tlie  face  of  uncertain  input  availabilities 
(the  first-stage  decision),  a  subsequent  action  is  initiated  on  the  basis 
of  the  inputs  realized  (the  "stochastic"  second-stage  decision),  and  the 
commitment  is  finally  realized  through  such  compensatory  activities  as 
might  be  made  necessary  by  the  discrepancies  found  between  the  inputs 
predicted  at  the  time  of  the  commitment  decision  and  the  Inputs  realized  at 
the  time  of  the  Initial  commitment  activity  (the  third-stage  decision). 

It  is  this  category  of  problem  that  is  termed  a  "generalized  stochastic 
program  with  deterministic  recourse." 

Within  the  above  framework  some  additional  specialization  is  encountered 
it  is  assumed  that  the  second-stage  random  variable  has  a  discrete 
distribution  with  a  finite  number  of  points  of  positive  probability. 
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Two  subclasses  of  this  type  of  programming  problem  are  considered  -  one 
in  which  a  feasible  solution  always  exists  and  the  ocher  in  which  it 
might  not.  The  former  are  termed  problems  with  "complete  recourse"  and 
the  latter  problems  with  "incomplete  recourse."  In  the  presentation  the 
method  of  solution  suggested  is  essentially  the  same. 

After  a  brief  literature  review  and  presentation  of  the  model  to  be 
discussed,  the  main  concern  of  the  paper  is  with  the  development  of  a 
solution  algorithm  for  the  class  of  problems  described.  Several  quoted 
results  lead  to  the  conclusion  that  a  modified  cutting  plane  algorithm 
might  be  applicable  to  the  lormulation  given.  The  method  presented  will 
converge  in  a  unite  number  of  steps  to  a  solution  whose  value  is 
arbitrarily  close  to  the  optimal  solution  value.  A  discussion  of  that 
approach  incorporating  convergence  "proofs"  follows.  The  length  of  this 
dialogue  coupled  with  a  complete  lack  of  illustrative  examples  or  numerical 
results  tends  to  detract  from  the  presentation  somewhat. 

References:  [5],  [10],  [24],  [26],  [37],  [63],  [9Aj  ,  [lOA],  [llA],  [ 13A] , 

[ISA],  [20A],  [24A],  [42a]. 

Alternates;  Shailendta  Chimanlal  Parikh,  "Generalized  Stochastic  Programs 
with  Deterministic  Recourse;,"  Ph.D.  Thesis,  Department  of 
Industrial  Engineering,  University  of  California,  Berkeley, 
July,  1967. 

Referenced  by:  [27A] ,  [46A] . 


26 


[21A]  A.  C.  Williams,  "Nonlinear  Accivicy  Analysis  and  Duality," 

Proceedings  of  Intetnacional  Symposium  on  Mathematical 

ProRramming ,  H.  W.  Kuhn,  ed.,  Princeton  University  Press, 

Princeton,  New  Jersey, 

This  paper  is  both  an  introduction  and  a  review  of  duality  concepts 
for  convex  programming  problems-  Primal-Dual  problems  ate  developed  on 
the  basis  of  a  restricted  conjugate  tunction  space  for  the  primal  problem 
which  incorporates  special  linear  functionals.  The  development  as  presented 
does  not  require  differentiability  assumptions.  A  two-stage  uncertain 
linear  program  which  has  appeared  in  previous  publications  is  used  to 
illustrate  the  duality  concept  developed.  To  further  enhance  intuitive 
understanding,  economic  interpretations  of  the  conjugate  'dual)  forms  is 
given  in  terms  of  the  interrelationships  between  a  hypothec  veal  entrepreneur 
and  a  hypothetical  contractor.  The  entrepreneur  is  faced  with  the  problem 
of  producing  the  goods  he  requires  tor  his  activities  or  purchasing  them 
from  the  contractor.  The  contractor  must  resolve  a  dual  decision  problem. 

References:  [9A],  [llA],  [13A],  [i^A],  (26.4],  [29.4] 

Alternates:  A.  C-  Williams,  "Programming  Under  Uncertainty:  The  Linear 

Recourse  Problem,"  paper  presented  at  the  Sixth  International 
Symposium  on  Mathematical  Programming,  Princeton  University, 
Princeton,  New  Jersey,  August,  1967. 

Referenced  by:  [^7A], 
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[22A]  R.  Jagannatlin,  "An  Algorithm  for  Differentiable  Convex  Functional 
Programming  with  Examples  and  Applications  to  Linear  Programming 
Under  Uncertainty,"  Management  Sciences  Research  Group,  Graduate 
School  of  Industrial  Administration,  Camegie-Mellon  University, 
Management  Sciences  Research  Report  No.  114 ,  August,  1967. 

This  report  is  concerned  with  the  presentation  of  a  computational 
algorithm  for  solving  convex  programaning  problems  with  linear  constraints 
and  a  "continuously"  di t f erent lab] criterion  function.  The  procedure  is 
discussed  in  Section  3  and  makes  use  of  a  quadratic  approximation  to  the 
original  program  objective  form.  Given  an  initial  feasible  solution  for 
the  total  problem,  a  parametric,  quadratic  objective  fonri  is  used  to 
produce  a  revised  solution  This  "quadratic  iteration"  is  oonuinued  until 
a  close  enough  approximation  to  the  optimum  is  achieved.  A  simple  numerical 
example  is  given  to  illustrate  the  method's  operation. 

In  Sections  4,  5  and  6  of  the  report  the  applicability  of  the  method  to 
two-stage  linear  programming  under  unoertainty  problems  is  discussed.  It 
is  shown  that  the  necessary  conditions  assumed  by  the  algorithm  are  satisfied 
by  stochastic  programs  with  "complete"  recourse  having  right-hand-side 
vectors  with  absolutely  continuous  distribution  functions,  by  programs 
having  both  a  stochastic  right-hand-side  vector  and  a  stochastic  constraint 
matrix  associated  with  the  first-stage  decision  variables  in  the  second-stage 
constraints  with  the  random  vaiiables  of  concern  described  by  a  multivariate 
normal  distribution,  and  by  similar  programs  with  stochastic  penalty  functions 
which  satisfy  appropriate  convexity  assumptions.  A  single-period  portfolio 
selection  problem  is  formulated  to  exemplify  the  practicality  of  the  abstract 


structures  discussed. 
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References:  [5],  [9],  [10],  [12],  [20],  [24],  [26],  [30],  [37],  [39],  [4?], 

[45],  [50],  [53],  [63],  [8A] ,  [lOA],  [llA],  [19A] ,  [24A] ,  [30A]. 

Alternates:  R.  Jagannathn,  "An  Algorithm  tor  Differentiable  Convex  Functional 
Programming  with  Examples  tor  Applications  to  Linear  Programming 
Under  Uncertainty,"  paper  presented  at  the  Tenth  American  Meeting 
of  The  Institute  of  Management  Sciences,  Atlanta,  Georgia, 

October  1-3,  1969.  Also  Rajagopalan  Jagannathn,  "Solution 
Procedures  for  Multi-Stage  Linear  Programming  Under  Uncertainty 
and  Applications,"  Management  Sciences  Research  Group,  Graduate 
School  of  Industrial  Administration,  Carnegie-Mellon  University, 
Management  Sciences  Research  Report  Wo.  158,  May,  1969 
(Ph  D.  Thesis) 

Referenced  by:  [37A] 
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( 23A]  David  A.  KOhlet ,  "Projections  of  Convex  Polyhedral  Sets,"  Operations 
Research  Center,  University  of  California,  Berkeley,  ORC  67-29, 

August,  1967. 

This  paper,  which  is  concerned  with  the  elimination  of  a  subset  or  a 
set  of  decisJon  variables  in  a  group  of  linear  Inequalities,  has  direct 
application  to  problems  formulable  as  two-stage  linear  programming  under 
uncertainty  problems.  Given  a  sec  of  linear  Inequalities  in  two  sets  of 
decision  variables,  ir  Is  shown  how  an  equivalent  set  or  inequalities  can 
be  constructed  which  inoorporate  only  Che  second  set  of  original  decision 
variables.  This  is  done  by  considering  elements  of  the  null  space  of  the 
constraint  matrix  of  the  first  sec  of  decision  variables.  It  is  shown  that 
elimination  of  the  first  set  of  decision  variables  is  equivalent  to 
constructing  a  prcjectirn  cf  the  convex  polyhedral  set  defined  by  the  total 
set  or  inequalities  onto  the  space  spanned  by  the  second  sec  of  decision 
variables  A  method  for  acc-cmplishing  this  task  (a  modification  of  the 
Fourier-^^oc^kl(l  method  for  eliminating  variables  from  a  set  of  linear 
inequalities)  is  discussed.  The  procedure  developed  is  basically  an 
algor ithni  for  finding  the  (unique)  frame  of  the  pointed  convex  cone  of 
elements  in  the  null  space  of  the  eliminated  set  of  decision  variables 
constraint  matrix.  The  several  examples  interspersed  throughout  the  text 
contribute  toward  making  the  presentation  a  most  readible  one. 

References:  [63],  [15A]. 

Alternates;  Available  as  AD  659301.  Also,  David  Anthony  Kohler,  "Projections 
of  Convex  Polyhedral  Sets,"  Ph.D.  Thesis,  Department  of  Industrial 
Engineering,  University  of  California,  Berkeley,  August,  1967. 
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[2AA]  David  W.  Walkup  and  Roger  J.-B.  Wets,  "Stochastic  Programs  with 
Recourse,"  Journal  of  the  Society  of  Industrial  and  Applied 
Mathematics ,  Vol.  15,  No.  5,  September,  1967,  pp.  1299-1314. 

Stochastic  programs  with  recourse  are  a  generalization  of  a  particular 
form  of  stochastic  linear  programming  called  "two-stage  linear  programs  under 
uncertainty".  The  former  are  obtained  from  the  latter  by  allowing  some  (or 
all)  of  the  objective  function  coefficients  and  the  second-stage  constraining 
relation  coefficients  to  be  subject  to  stochastic  fluctuations.  This  is  in 
contrast  to  the  usual  two-stage  formulation  in  which  only  the  righc-hand-side 
coefficients  of  the  second-stage  constraining  relations  are  presumed  to  be 
described  by  a  random  variable. 

The  tenor  of  the  paper  is  to  establish  '.ondicions  under  which  stochastic 
programs  with  recourse  can  be  reduced  to  an  equivalent  deterministic  convex 
programming  problem  (continuous  distt ibutions  of  the  program  random  variables 
are  assumed  throughout).  This  is  a.-tcmpli&hed  by  first  establishing 
conditions  under  which  the  program- constraint  set  is  convex  and  then  demonstrating 
the  convexity  of  the  associated  program  objective  form.  In  the  former  instance 
one  of  the  prime  items  for  consideration  is  the  propriety  of  replacing  the 
domain  of  definition  of  the  program  random  variable  by  its  closure  and  yet 
maintaining  the  integrity  of  Che  original  problem  formulation.  Conditions 
under  which  this  procedure  will  produce  a  consistent  answer  relative  to  the 
initial  problem  are  established  by  recourse  to  some  topological  set  constructions 
and  some  continuity  properties  of  convex-cone-valued  mappings.  It  turns  out 
that  the  second-stage  constraint  matrix  associated  with  the  second-stage 
decision  variables  is  the  pivotal  factor  in  the  discussion.  In  the  case  of 
the  objective  form, convexity  is  established  in  the  usual  manner.  It  is  also 
shown  that,  under  mildly  restrictive  conditions,  the  contribution  of  the 
second-stage  variables  to  the  program  objective  is  finite  and  satisfies  a 
Lipschitz  condition 
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The  notation  and  constructions  adopted  in  this  article  do  not  allow 
its  concent  to  be  absorbed  through  a  cursorv  reading-  In  fact,  one  wonders 
if  at  times  conceptual  clarity  has  not  been  sacrificed  tor  the  sake  of 
mathematical  abstraction. 


References:  [9],  [10],  [37],  [5?l,  [9A],  [lOA],  [15A].  [25A] 

Alternates:  David  W.  Walkup  and  Roger  J.  B.  Wets,  "Stochastic  Programs  with 
Recourse,"  Boeing  Sclent.,  iic  Research  Laboratories,  Document 
PI  82-0551  (Mathematic,-  Le.  earch  Laboratory,  Mathematical 
Note  No  July,  19cC 

Referenced  by:  [20A],  [22A],  [2AA].  [26A].  [27a],  (28A],  [30A],  [31A],  [32A], 
[36A],  [37A],  [39A],  [40A] ,  [45a],  [46A] 
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[25A1  David  W.  Walkup  and  Roger  J.  B  V/ets,  "Scothasuic  Programs  with 

Recourse:  Special  Forms,"  Boeing  Scientific  Research  Laboratories, 
Document  Dl-32-0627  (Mathematics  Research  Laboratory,  Mathematical 
Note  No.  516)  August,  1967. 

A  "stochastic  program  with  recourse"  is  obtained  from  a  "two  stage"  linear 
programming  under  uncertainty  problem  by  assuming  chat,  in  addition  to  the 
right-hand-side  coefficients  of  the  second-stage  constraints,  the  coefficients 
of  the  linear  objective  form  and  the  second-stage  constraint  technology  matrices 
are  subject  to  random  fluctuations.  Thus,  in  general,  an  arbitrary  lirst-stage 
decision  may  not  allow  a  reasible  second-stage  decision  to  be  initiated  for 
all  possible  combinations  of  the  stochastic  parameter  values.  The  concern  of 
this  document  is  with  some  special  forms  of  this  class  of  problems  which  are 
theoretically  and  computationally  tractable. 

The  key  entity  in  the  stochastic  program  with  recourse  problem  is  the 
second-stage  technology  matrix  assocl_.ed  with  the  second-stage  decision 
variables.  If  this  matrix  is  such  that  all  first-stage  decisions  are  acceptable 
to  the  total  problem  with  respect  to  feasibility,  a  stochastic  program  with 
complete  recourse  is  the  result;  if  the  matrix  is  a  constant,  the  problem  is 
one  of  fixed  recourse;  and  if  the  matrix  is  square  and  nonsingular  with 
probability  one,  stable  recourse  occurs.  Tlie  preceding  then  are  the  "special 
forms"  discussed  by  the  subject  paper. 

The  first  part  of  the  presentation  is  taken  up  with  definitions  and  a 
statement  of  results  drawn  from  a  prior  paper  which  have  bearing  on  the  special 
forms  to  be  discussed.  For  the  "special  forms"  considered  conditions  under 
which  the  equivalent  deterministic  problem  is  a  convex  program  are  discussed. 
Various  specializations  permit  conclusions  with  respect  to  the  separability, 
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convexiny,  and  existence  ot  bounded  first  partial  derivatives  of  the 
program  objective  forms.  This  last  characteristic  leads  to  some  speculation 
on  the  appropriateness  of  previous  solution  procedures  lot  application  to  the 
problem  types  under  discussion.  It  is  also  shown  how  previous  results  can  be 
accommodated  in  the  framework  oi  stochastic  programs  with  recourse.  Examples 
given  include  a  "stochastic  linear  program"  incorpotacing  the  "active" 
approach  to  decision  making  and  a  conditj.onal  probability  model  for  stochastic 
programs  with  "chance  const -aints" . 

References:  [301,  [3'^],  161],  i6.3j  ,  [8A),  [9a]  ,  [lOA],  [llA],  [13Aj, 

[19A],  [24A],  [42A].  [46a] 

Alternate.?:  Da/id  iv.  Walkup  and  Roger  J,  B.  Wets,  "Stochastic  Programs  with 

Recourse:  Special  Foims,"  Proceedings  cf  the  Sixth  International 
Sympofium  on  Mathematical  Programming,  H.  K,  Kuhn,  ed.,  Princeton 
University  Press,  Princeton,  New  Jet.sey. 
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[26a]  a.  Charnes ,  M.  J.  L.  Kirby,  and  W.  M.  Raike,  "Solution  Tlieorems  in 
Probabilistic  Programming:  A  Linear  Programming  A.pptoach," 

Journal  of  Mathematical  Analysis  and  Applications  .  Vol.  20,  No.  3, 
December,  1967,  pp .  565  582. 

The  avowed  purpose  of  this  article  is  to  correlate  the  results  of 
other  researchers  in  the  subject  area  in  an  effort  to  present  a  new  viewpoint 
on  some  of  the  previously  studied  problems.  To  this  end  several  specific 
topics  are  studied  in  some  detail.  After  a  brief  statement  of  the  two-stage 
linear  programming  under  uncertainty  problem,  three  theorems  are  presented 
which  produce  alternate  f ctTnulations  in  terms  of  a  deteririinistic  "constrained 
hypermedian"  problem  requiring  consideration  of  only  the  first-stage  decision 
variables.  Each  result  arises  from  a  specialization  of  the  general  two-stage 
problem. 

The  next  section  considers  in  some  detail  tf^e  <.ase  of  two-stage  linear 
programt mg  under  uncertainty  in  which  the  extrer'um  of  the  objective 
functional  is  not  actually  attained  but  comes  arbitrarily  close  to  some 
limiting  val'is  (the  "insoluable  finite"  cose).  The  concern  of  the  rather 
lengthy  d  i  ;::’ussl  on  presented  is  to  establish  the  equivalence  in  limiting 
behavior  of  the  objective  functional  under  a  known  sequence  of  defining 
decision  varlabler  and  another  sequence  which  moves  first  to  a  finite  extreme 
po  It  of  the  constraint  set  and  subsequently  along  an  extreme  edge  of  that 
convex  polytope.  The  last  paragraphs  establish  an  asymptotic  formula  for 
the  radial  directional  derivative  of  the  objective  functional  under  the 
assumptions  imposed,  an  expression  for  the  gradient  of  t.ie  objective  functional 
given  a  continuously  differentiable  distribution  function  for  the  problem 
random  variable,  and  an  expression  for  the  matrix  of  second  partial 
derivatives  of  the  objective  form. 
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The  last  topic  considered  is  the  general  N-stage  linear  programming 
under  uncertainty  problem.  An  alternate  prooi  of  a  previous  result  is 
supplied  and  some  observations  as  to  computational  procedures  for  solution 
of  this  class  of  problems  is  made. 


References:  [10],  [50],  [8A] ,  [9A] ,  [lOA],  [llA],  [12A].  [15A], 

[24A],  [35A],  [42A], 

Alternates:  A.  Charr.es,  M,  J.  L.  Kirby,  and  W.  M.  Raike,  "On  a  Special 
Class  of  Constrained  Generalized  Median  Problems,"  The 
Technological  Institute,  Northwestern  University,  Evanston, 
Ill.,  Systems  Research  Memorandum  No.  155,  April,  1966. 
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[27Aj  V'.'.  T,  Ziiiinba,  "Ou  Nonlinear  Stochastic  Programming  witli  Simple  Recourse," 

Center  for  Research  in  Management  Science,  University  of  California, 
Berkeley,  Working  Paper  No.  23-,  December,  1967. 


This  paper  reviews  the  literature  on  two-stage  stochastic  programs 
through  i967.  Although  some  mention  is  made  of  the  "general"  two-stage 
stochastic  program  f orrmulations  available  in  the  literature,  the  discussion 
in  the  main  is  concerned  with  the  "complete"  or  "simple  recourse"  problem. 

Two  decision  problems  (an  inventory  situation  and  an  economic  system  model) 
are  described  and  cast  as  two- stage  programming  under  uncertainty  problems. 
Sufficient  conditions  to  insure  continuous  dtrferentiability  of  the 
objective  function  of  the  equivalent  conveK  program  are  given.  These  arc 
illustrated  for  the  case  of  a  separable  objective  incorporating  quadratic 
terms  in  tire  second'scage  uccision  vaiiables  b.  piesentjng  tlic  objective 
function  and  its  derivatives  ior  the  cases  of  normally,  exponentially, 
uniformly,  and  multivariate  normally  distributed  r ight-hand-side  requirements 
vector  variation  laws.  In  the  last  instance  a  detailed  reduction  of  the 


expressions  is  not  given. 
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Business  Administration,  University  of  California,  Berkeley, 

•lui.''  ■'969.  W.  T.  Ziemba,  "Nonlinear  Stochastic  Programming 

'■  le  Recourse,"  Faculty  of  Commerce  and  Business 

tlon,  University  of  British  Columbia,  Working  Paper 
.pril,  1969. 
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[28Aj  Richard  M.  Van  Slyke  and  Roger  J-  -B.  Wets,  "Stochastic  Programs  In 

Abstract  Spaces,"  Stochastic  Optimization  and  Control  (Proceedings 
of  an  Advanced  Seminar  Conducted  by  the  Mathematics  Research 
Center  and  the  United  States  Army  at  the  University  of  Wisconsin, 
Madison,  October  2-4,  1967),  Herman  F.  Karreman,  ed.  ,  John  Wiley  & 

Sons,  Inc.,  New  York,  1968,  pp  25-45, 

This  work  purports  to  extend  the  existing  theory  relative  to  two-stage 
stochastic  linear  programs  defined  in  finite  dimensional  spaces  to  the  case 
of  more  general  abstract  spaces.  This  is  done  by  considering  reflexive 
Banach  spaces,  separable  probability  spaces,  linear  operators,  and  convex 
functionals  in  the  restatement  of  the  usual  formulation  which  uses  n-dimensional 
Euclidean  space  and  matrices  as  linear  operators. 

A  portion  of  the  work  is  related  to  the  discussion  of  stochastic  control 
problems  as  two-stage  stochastic  linear  programs.  Here  some  well-known  results 
for  stochastic  control  problems  which  can  be  cast  i.n  terms  of  linear  vector 
differential  equations  are  stated  and  discussed  relative  to  possible 
stochastic  variation  in  the  equation  parameters.  In  the  discussion  a  relation¬ 
ship  to  the  two-stage  stochastic  programming  problem  is  established. 

Another,  larger  portion  of  the  paper  is  taken  up  with  the  equivalent 
deterministic  problem  and  the  set  of  feasible  solutions  for  the  subject 
"generalized"  two-stage  linear  programming  problem.  The  discussion  of 
these  sections  is  taken  up  with  a  restatement  of  several  Theorems  and  proofs 
of  the  previous  papers  cited  in  terms  of  the  more  abstract  formulation 
defined  in  the  opening  remarks  to  the  paper.  A  final  section  remarks  on 
the  connection  of  the  previous  discussion  to  stochastic  programs  which  are 
completely  analogous  with  respect  to  the  linearity  and  regularity  conditions 
imposed  to  the  usual  linear  programming  formulation. 
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[9],  [15],  [37],  (lAl,  (2a].  [9A],  [IOa],  [llA],  [12A],  [13A], 
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Richard  M.  Van  Slyke  and  Reger  J.-B.  Wets,  "Stochastic  Programs 
in  Abstract  Spaces,"  Boeing  ScientitiC  Research  Laboratories, 
Document  Dl-32-06?2  (Mathematics  Research  Laboracot le? , 
Mathem-’ticai  Note  No.  539),  October,  i96  7. 
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[29A]  A.  C-.  Williams  and  M.  Avriel,  "Remarks  on  'Linear  Programming  Under 
Uncertainty',"  Operations  Research.  Vol.  16,  No.  1,  January- 
February,  1968,  pp.  198-203. 

This  note  is  a  brief  remark  on  an  earlier  article  which  presented  a 
dual  program  to  the  two-stage  linear  programming  under  uncertainty  problem 
in  the  case  of  a  Joint  normal  distribution  characterizing  the  components 
of  the  stochastic  right-hand-side  vector.  A  dual  problem  suitable  for  two- 
stage  linear  programming  under  uncertainty  problems  with  arbitrary  continuous 
probability  distribution  functions  with  finite  first  moments  is  stated.  It 
is  shown  that  specialization  of  this  result  produces  the  form  of  the  previous 
paper.  It  is  further  established  that  the  optimal  solution  does  not  explicitly 
depend  on  the  mean  and  variance  of  the  marginal  distributions  of  the  random 
right-hand-side  coefficient  variables. 

References:  (8A]  ,  [9a]  ,  [lOA]  ,  [llA],  113A},  [lAA). 
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[30A]  A.  H.  Dempster,  "On  Stochastic  Linear  Programming  I.  Static 

Linear  Programming  Under  Risk,"  Journal  of  Mathematical  Analysis 
and  Applications,  Vol .  21,  Ki.  2,  February,  1968,  pp .  304-343. 

This  paper  represents  the  single  tiost  comprehe;  sive  study  cl  "two-stage 
linear  programming  under  uncertainty"  and  its  var rents  available  in  the 
literature  to  the  date  or  the  artrcle.  The  approach  adopted  in  the  main  is 
geometric  rather  than  algebraic.  That  i? ,  the  results  presented  are  described 
in  terms  ot  the  theory  of  convex  pclyheita  with  frequent  appeal  to  gacrrjetric 
constructions  rathe’-  chan  pro'.eeding  on  the  basis  ot  algebraic  manipulation 
of  the  basic  problem  formulation.  A  must  article  for  the  serious  student  of 
probabilistic  programming. 

The  paper  is  divided  into  six  se. lions.  Seciicn  1  is  introductory  and 
describes  the  problem  to  be  presented  in  general  terms  by  relating  it  to  the 
appropriate  analrgcus  discussions  in  the  available  open  literature.  Section  2 
is  brief  and  presents  the  notation  and  definitions  to  be  adopted  throughout  the 
remainder  ci  the  text  Section  3  praaents  a  formulation  cf  "the  discrepancy 
cost  approach  tc  stochstic  programming"  and  indicates  its  place  in  respect 
to  the  general  area  ot  mathematical  programming  and  the  "chance  consttained" 
and  "stochastic  linear  programming"  approaches  to  problems  of  probabilistic 
programming.  The  "loss  function"  of  the  "discrepancy  cost'  approach  is 
introduced  and  discussed  in  its  general  abstract  linear  form.  Section  4 
introduces  the  concept  of  "quadratic  loss"  and  very  briefly  considers  its 
effect  on  the  fundamental  problem  to  be  considered. 

Sections  5,  6,  7,  and  8  comprise  the  "meat”  or  this  article.  Section  5, 
through  its  discussion  of  convex  poly topic  cones,  linear  inequalities,  and 
pseudo- inverses  (called  elsewhere  "Morse-Penrose  generalized  inverses"). 
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suffices  to  character ize  completely  the  general  nature  of  the  second-stage 
problem  constraint  set.  Proofs  and  interpretations  of  several  Theorems 
including  those  of  Minkovskl-Weyl  and  "ankowski  Farkas  are  given  and  related 
to  the  problem  at  hand.  Section  6  continues  the  development  along  the  same 
lines  by  establishing  necessary  and  sufficient  conditions  for  the  total 
discrepancy  cost  program  to  have  a  feasible  solution.  It  indicates  some 
optimality  conditions  which  the  optimal  feasible  solution  must  satisfy. 
Section  7  discusses  discrepancy  cost  stochastic  programs  in  which  the 
second-stage  constraint  set  establishes  the  set  of  feasible  solution  vectors 
as  a  pointed  cone.  Deterministic  equivalents  for  the  stochastic  program 
are  developed  and  the  constrained  linear  nature  of  the  progtam  objective 
functional  exhibited.  Section  8  performs  a  similar  service  for  the  case 
in  which  the  set  of  feasible  solution  vectors  is  a  linear  subspace.  In 
this  case  the  program  i^  reducible  >.c  the  "complete"  formulation  and  the 
loss  function  exhibits  piecewise  linear  behavior  in  the  program  first-stage 
decision  variables.  The  concluding  remarks  of  this  section  suggest  that 
tiie  techniques  suggested  for  the  problem  dichotomy  established  in  Sections  7 
and  8  provide  the  theoretical  basis  for  the  description  and  solution  of 
the  general  "stochastic  program  with  linear  discrepancy  cost"  or  "two-stage 
linear  programming  under  uncertainty"  ptoblem. 

References:  [5],  [6],  [7],  (9),  [10],  [20],  [26],  [27],  [30],  [37],  [38], 

[43],  [45],  [50],  [531,  [34],  [57],  [58],  [8A],  [ llA] ,  [24a]. 
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Engineering  and  Science,  Hay,  1965. 
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f3lA]  David  Rutenbarg,  "Risk  Aversion  in  Stoahastic  Progiamming  with  Recourse," 
Management  Sciences  Research  Group,  Graduate  School  of  Industrial 
Administration,  Carne.gie  Mellon  Univeisitv,  Management  Sciences  Research 
Report  No.  132,  February  1968 

One  previous  two-stage  linear  piogramming  under  uncertaint\  problem  which 
has  appeared  in  the  literature  proposes  the  solution  of  problems  with  discretely 
distributed  right-hand-side  random  coefficients  through  consideration  of  the 
large  linear  program  obtained  by  writing  all  possible  program  cccurrences  in 
a  single  tableau.  "Relative  cost  c ;ef f ic ients"  for  the  program  are  defined 
as  those  occurring  in  the  pa.cent  formulation  weighted  by  the  probability  of 
occutrance  of  the  right-hand -side  vector  event  cot t asponding  to  each  "second- 
stags"  problem  generated.  The  prograiti  objective  is  to  extremi?i  the 
expectation  (here  a  finite  sum  of  positivei>  weighted  li.near  teim; '  ot  the 
associated  criterion  function 

The  subject  paper  uses  the  above  formulation  as  a  point  of  departure 
to  question  the  general  applicability  of  assuming  a  utility  function  which 
is  linear  in  the  program  decision  variables  in  situ^ions  of  decision  making 
under  risk.  It  is  argued  that  a  mote  reasonable  apprcach  would  be  to  adopt 
a  criterion  function  which  will  reflect  the  "risk  aversion"  behavior 
commonly  exhibited  by  decision  makers  when  faced  by  uncertainties,  i  e  , 
a  criterion  function  concave  In  the  program  decision  variables  should  be 
considered.  Such  a  function  is  incorporated  into  the  formulation  in  terms 
of  its  general  characteristics  anu  a  solution  approach  based  upon  two  well- 
known  contemporary  convex  piogramming  solution  algorithms  is  outlined. 
Suggestions  as  to  avenues  for  further  research  efforts  are  made  in  the 
concluding  remarks. 

References:  [10],  [37],  [8A],  [lOA].  [13A],  (24A],  [42A]. 
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( 32A]  R.  S.  Sachai,  "On  the  Nonlinear  Stoehastrc  Pi cgramming  Problems," 
Cahiers  du  Centre  d'Etudes  de  Recherehe  Operatiouelle ,  Vol.  10, 

No,  I,  1968,  pp.  84-99 

This  paper  appears  Co  be  a  restaLement  of  the  results  obtained  by  other 
authors  in  sor.ie  previous  papers.  The  extension  arises  In  that  the  rlght- 
hand-side  random  variables  and  the  objective  function  coefficients  are 
allowed  to  be  functions  of  one  another.  Inequalities  between  the  "expected 
value",  the  "tat",  and  the  expected  a  posteriori  solutions  objective  function 
return  teall^ed  are  developrd  i.among  others).  Some  simple  illustrative 
numerical  examples  ace  presented  in  the  final  seccion. 

References:  [lA],  [2A].  [lAl,  (lOA],  [ISA],  124A]. 
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[33A]  Nak  Je  Kim,  "Lino;it  Pcv'^uaiiiniinn  wil'h  Ramim'i  Roqu ii emcnts , "  lepoit 
Utah  U'ater  Reseatcli  Laboratory,  Ktali  State  Uiuversity,  Loj;aii , 
Utah,  1968 


Not  received  for  rcvio'.v’  Indications  are  that  this  is  a  very  simple 
survey  article. 
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134a1  J.  L  M'.dler  and  R.  D.  Wollmer,  "A  Flight  Planning  Model  for  the 
Military  Airlift  Command,"  The  RAND  Corporation,  Santa  Monica, 

California,  Memorandum  Rfj-5?22-PR,  October,  1968 

Tf.is  paper  J.s  the  first  of  a  series  to  be  concerned  with  the  development 
and  iniplementation  of  a  flight  scheduling  model  for  the  Military  Airlift 
Command.  The  basic  problem  is  one  of  scheduling  the  allocation  of  aircraft 
to  routes  so  that  anticipated  costs,  including  those  arising  as  a  result  of 
uncertain  transport  tequirements ,  are  minimized.  A  monthly  planning  model 
is  used  to  develop  an  initial  schedule  and  a  daily  model  operates  within  the 
monthly  period  to  define  needed  schedule  adjustments  and  other  compensatory 
activities  as  the  state  or  the  system  evolves.  Both  models  are  developed  as 
twn-stage  linear  ptogtamming  under  uncertainty  problems  having  "complete" 
recourse . 

The  total  problem,  as  is  noted,  is  in  actuality  a  multiple  period 
sequential  decision  problem-  The  formulation  given  incorporates  a  tvo-level, 
nested  set  of  two-stage  programs  with  "virtutil'’  oi  fictitious  second-stage 
decisions  in  order  to  produce  a  c cmputationaily  feasible  algorithm.  Each 
monthly  schedule  is  generated  on  the  basis  of  the  current  status  of  the 
system  and  a  second-stage  decision  which  accounts  for  uncertainty  in  the 
forthcoming  month  viewed  as  a  single  decision  period.  This  second-stage 
decision  is  never  realized  in  that  the  projected  schedule  is  input  into  the 
daily  model  to  be  operated  upon  by  the  daily  model  as  the  month  progresses. 

The  dally  model,  operating  recursively  on  a  two  stage  basis  (outputs  on  a 
given  day  are  Inputs  for  the  next),  produces  a  revised  statement  of  the  state 
of  the  system  at  montli's  end  which  is  used  in  dettirmining  the  next  month's 
sciiedule  projection  and  so  on. 
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Tvo  computational  methods  applicable  to  problems  with  continuously 
distributed  random  tight  hand-side  vectors  are  outlined  (a  cutting  plane 
method  and  a  gradient  minimi?ation  meciiod.i  .  In  this  discussion  a  good 
introductory  statement  or  the  theoretical  aspects  ot  constraint  generation 
and  the  two  proposed  solution  techniques  is  made.  A  small-scale  numerical 
example  of  the  solution  or  the  monthly  model  comprises  the  final  section 
of  the  paper . 

References:  [37],  [IOa],  (11a],  [SSA],  [42Aj 

Alternates : 

Referenced  by  ■. 


4  / 


[35a]  Katta  G.  Murty,  "Two-Stage  Linear  Ptogtammlng  Under  Uncertainty: 
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L'ahrstbelnllchkeitstheorle  und  Verwandte  Gebiete,  Vol.  10, 

No-  October,  1968,  pp  284-288 

If  a  finite  optimal  solution  to  a  two-stage  uncertain  linear  program 
exists,  the  main  result  of  this  paper  assures  that  the  solution  is 
describable  in  terms  of  a  set  of  linearly  independent  column  vectors  which 
correspond  to  the  positive  components  of  the  first-stage  decision  variables 
appearing  in  the  optimal  solution.  A  bound  on  the  number  of  column  vectors 
is  also  given.  It  is  noted  that  the  stated  result  is  easily  extended  to 
the  case  of  an  analogously  fcrmulated  multi-  stage  linear  programming  under 
uncertainty  problem. 

References;  (10),  fS'’],  [63],  [lOA],  [15A]. 
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Center,  University  of  California,  Berkeley,  ORC  66-4, 

February,  1964. 


Referenced  by:  [26A],  [34A],  [42A]. 


[36A]  David  W.  Walkup  and  Roger  J,-B.  Wats,  "A  Note  on  Decision  Rules  for 
otochastic  Programs,’’  Journal  oi  Computer  and  System  Sciences, 

Vol.  2,  No.  3,  October,  1968,  pp .  303-311. 

The  purpose  of  this  paper  is  to  demonstrate  the  fact  that  the  objective 
form  of  the  usual  two-stage  linear  programming  under  uncertainty  problem  is 
piecewise  linear  In  the  first  stage  decision  variables.  It  if  also 
demonstrated,  by  means  of  a  simple  example,  that  the  same  behavior  is  not 
exhibited  by  the  objective  f.iti-.is  ot  problems  involving  three  (c:  mote) 
distinct  decision  stages-  The  Implications  of  the  conclusion  reached  with 
respect  to  some  of  the  better  known  contemporary  sequential  probabilistic 
programming  models  is  noted  also. 

References:  (10],  (lOA).  [llA],  [24A).  [25A).  [40a) 

Alternates:  David  W.  Walkup  and  Roger  J.  B.  Wets,  "A  Note  cn  Decision  Rule? 

for  Stochastic  Program.s,"  Boeing  Scientitic  Research  Laboratotie 
Document  Dl-82-0'2^  (Mathematics  Research  Laboratoc les  , 
Mathematical  Note  No  560),  May.  1968. 
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[37A]  R.  Jagannathn,  "A  Solution  Procedure  for  a  Class  of  Multistage 
Linear  Programming  Problems  Under  Uncertainty,"  Management 
Sciences  Research  Group,  Graduate  School  of  Industrial 
Administration,  Carnegie-Me.llon  University,  Management  Sciences 
Research  Report  No.  146,  November,  1968. 

The  tone  of  this  article  is  set  by  the  opening  remarks  in  which  tlie 
multistage  linear  programming  under  uncertainty  problem  is  described  by  a 
simple  dynamic  programming  formulation.  It  is  shown  that  this  description 
IS  appropriate  as  an  inventorv  model  description  and  under  suitable 
assumptions  yields  a  convex  programming  problem.  A  solution  algorithm  for 
the  multistage  program  for  the  case  of  a  single  stociiaatic  constraint  per 
decision  period  is  discussed.  The  procedure  developed  is  based  upon 
approximating  the  possibly  unseparable  objective  form  for  each  decision 
stage  by  a  separable  function  obtained  through  estimating  the  "certainty 
equivalents"  for  the  program  random  variables.  The  net  result  is  a  series 
of  convex  programs  each  in  .a  single  decision  variable  instead  of  a  single 
multistage  problem  in  several  decision  variables.  The  extension  to  the  case 
of  several  stochastic  linear  constraints  per  period  then  follows  quite  easily. 
A  possibility  for  application  of  the  finaJ  model  is  exhibited  by  formulating 
a  capital  budgeting  decision  process  in  terms  of  the  mathematical  structure 
developed  earlier  in  the  paper.  No  numerical  results  are  given. 
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In  thLs  paper  ic  is  shovvTi  c.!iat  ,  gi'.on  i  s'.ti'.tiv  iiii  raic  itig,  continuous, 
differentiable  set  ot  niatginal  density  lunct’ons  tot  she  >.  ight-band-s  ide 
landom  variables  ot  a  two  stage  linear  p:ogram  unaet  unt  ei  taini  ,  an 
equivalent  chance  constrained  programming  piobiem  car.  be  exhibAted.  In  the 
main  the  results  achieved  lesi  cn  vhe  optimalii>  ^  cndit Aon.s  of  appropriate 
Lagiangian  saddle-point  function.s.  The  tin.-ii  le.-.uit  extends  the  rationale 
to  the  case  in  whi.h  the  t  rntribution  or  the  se. end-stage  decision  variables 
produces  a  r.cnline.ar  cirje.tive  function  which  is  sep-siabie  and  convex  in  the 
program  decision  variables. 
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[39A]  David  P.  Rutenbcrg  and  Stanley  J.  Garcska,  "Computation  in  Discrete 
Stochastic  Programs  with  Recourse,"  Management  Sciences  Research 
Group,  Graduate  School  of  Industrial  Administration,  Carnegie- 
Mellon  University,  Management  Sciences  Research  Report  No.  151. 
January,  1969. 

The  problem  of  developing  a  computational  scheme  for  stochastic  prograinS 
with  recourse  (two -stage  linear  programs  under  uncertainty)  when  the 
right-hand-side  constraint  vector  is  described  by  a  discretely  distributed 
random  variable  is  the  subject  of  this  paper.  The  procedure  discussed 
Involves  systematic  enumeration  of  all  of  tlie  possible  occurances  of  the 
right -hand-side  vector  via  a  branch  and  bound  technique.  Each  of  the 
possible  basis  matrices  for  the  secend-stage  decision  variable  constraint 
matrix  is  investigated  relative  to  the  right  hand-side  vector  occurances 
fer  which  It  guarantees  a  leasiblt.  second-stage  decision.  Available 
techniques  fiom  the  theory  of  parametric  linear  programming  are  used  in  the 
assessment.  Although  not  explicitly  pointed  out,  the  elimination  could  be 
used  to  determine  if  a  feasible  solution  to  the  total  program  exists  and  if 
so,  to  generate  additional  constraints  for  imposition  on  the  first-stage 
decision  variables  which  guarantee  second-stage  feasibility  for  decisions 
drawn  from  the  resultant  first-stage  decision  variable  constraint  set. 
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The  main  result  of  this  note  Is  to  establish  that  the  expectation  ol  a 
continuous  convex  function  which  incorporates  a  random  variable  as  one  of 
its  arguments  is  again  a  continuous  convex  function.  This  of  course  requires 
that  the  expectation  be  lower  semicontinuous  over  its  range.  Following  this 
result  an  analogou.s  Theorem  appropriate  to  the  description  ol  an  cbjective 
form  for  a  stochastic  program  wj th  recourse  is  stated.  An  exam.pie  is 
given  which  is  illustrative  cl  the  reasons  that  in  general,  one  may  not 
presume  that  the  expectation  ot  a  convex  function  is  continuous. 

The  discussion  cf  the  primary  thought  ot  this  paper  is  self-contained. 

It  is  unfortunate,  perhaps,  that  the  subsequent  example  draws  upon  notation 
and  ideas  presented  in  a  previous  paper. 
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Scientific  Research  Labotati.ries ,  Ducument  D1-82-07Q4 
(Mathematics  Research  Laboratory,  Mathematical  Mote  No.  548), 
January,  1968. 
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[42a]  R.  M.  Van  Slykc  and  Roger  V.-ees,  "L  Shaped  Linear  Piogiams  with 
Applications  to  Optimal  Control  and  Stochastic  riogramming , " 

Journal  ol  the  Society  ot  1  ndus  t  c  1  a  1  and  Apiilled  Matlicmat  i  cs  , 

Vol.  17,  No.  4,  July,  IVoV 

An  L-bhaped  linear  program  is  a  linear  piogram  in  wb.ii.h  ihc  nature  o) 
the  set  of  linear  constraints  is  such  th.at  (by  suitable  rearrangement,  it 
necessary)  the  non-zeto  entries  of  the  coetticieni  matrix  corresponding  lo 
the  program  decision  variables  exhibit  a  "block  L"  sttuctuce.  This  fotm  is 
exploited  in  this  paper  by  [lar  r  1 1 1  vining  tlio  p-ogtam  ciiiatiaints  and  decision 
variables  into  tlie  two  natural  subsets  dellned.  A  two-stage  pi imal-dual 
solution  procedure  is  proposed  which  turns  out  to  be  a  tutting  plane 
generating  algorithm.  The  duality  ct  tins  approach  with  the  well  known 
decomposition  method  oi  solu’.  i-'-n  tor  large  sr.alo  linear  pcogtams  is  noted. 


Although  no  computational  results  ate  presciiled,  separate  discussions 
on  the  method's  applicability  to  solution  ol  optimal  control  problems  with 
state  constraints  and  two-stage  uncertarn  linear  programs  are  given.  The 
geometric  interpretations  with  respect  to  convex  polyliedral  cones  and  sets 
interspersed  throughout  the  text  aid  the  presentation 
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Programming,"  Boeing  Scientific  Research  Laboratories, 

Document  Dl-82-0526  (Mathematics  Research  Laboratories, 
Mathematical  Note  No.  520),  August,  1967.  Also  by  the  same 
authors  and  under  the  same  title  as  ORC  66-17,  Operations 
Research  Center,  University  of  California,  Berkeley, 

July,  1966. 
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June  1  '  ' 2U ,  1 yoy 

This  paper  con.-  dors  linc.ir  propt  .imnii  np  pi.-blenis  in  which  the  right- 
t.and-sldc  vcctois  ate  kiuun  to  bo  t  anjom  vaiiabies  but  foi  which  ihe 
dlstn but  tons  one  onknowii.  Tin  qu.’stions  winch  arise  ate  tlioraforc  to  be 
d  i  s' us.-L  d  lu  teiiiis  .1  ccMis  ,  del  ions  al  d  .s  i  i  i  bu  t  ion  - 1  r  ec  sut  slicul  studies. 
It  Is  .issumed  tlioii  '.n.,-  is  toquiioJ  t..  iniii.itc  av.t.iviiy  upon  the  basis  of 
crude  C'-st  Ittiatris  lot  the  system  .stochastic  pataraotet.s  and  subsequent 
modi  1  n,  at  i  ons  tc  the  cLibiiial  plan  ate  allowable.  The  question  now  arises 
as  to  the  advisability  ot  cliaiipiiip  il-.e  implemented  solution  once  obsei  vat  ton.s 
on  the  system  random  parameters  hive  been  taken.  Tills  decision  is  made  wltn 
ret'crencc  to  the  cost  of  niaking  the  changes.  These  might  involve  changing 
the  level  ol  the  activities  of  the  original  ptogi'a.n  of  revising  the  set  o£ 
optimal  decision  .ic  1 1 1’ 1 1 1 1.-  tas  parametric  linear  programming  analysis  will 
demonstrate).  It  is  argued  that  hypothesis  test.s  based  upon  distribution-free 
statistical  analysis  of  the  observations  can  be  used  to  make  a  more  meaningful 
decision  with  respect  to  the  significance  of  the  vaiiations  observed  than  a 
mere  ad  hoc  re-examiiiat  ion  of  the  former  solucion.  Wrlk's  method  and  a 
confidence  baud  approach  are  given  in  outline  torm  as  examples  of  appropriate 
tests . 
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This  paper  discusses  the  possibility  ot  using  the  interior  parametric 
sequential  unconstrained  maximization  technique  (SUMT>  ror  solution  ot 
nonlinear  programming  problems  with  special  reference  to  two-stage 
probabilistic  programming  problems.  An  outline  ter  the  SUMT  procedure  and 
the  assumptions  necessary  tor  its  applicability  to  a  particular  problem  is 
given  The  merits  of  this  approach  relative  to  the  solution  of  two-stage 
stochastic  programs  with  simple  recourse  are  then  indicated.  A  portfolio 
selection  prcblem  is  formulated  and  cast  into  a  form  suitable  rot  solution 
through  the  application  of  SLi-tT 
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[45A]  David  W.  Walkup  and  Roger  J.-B.  Uets,  "Some  Practical  Regularity 
Conditions  for  Nonlinear  Programs,"  Journal  of  the  Society  of 
Industrial  and  Applied  Mathematics  on  Control,  Vol. 7,  No. 37 
August,  1969. 


A  nonlinear  program  is  solvable  if  the  optimal  objective  function  value 
is  finite  and  achieved  for  an  admissible  decision  variable;  it  is  dualizable 
if  the  primal  and  dual  optimal  solutions  are  equal;  and  it  is  stable  if  an 
optimal  solution  can  be  achieved  through  use  of  the  Lagrangian  formulation. 

This  note  establishes  sufficient  conditions  for  a  class  of  nonlinear  programs 
to  possess  these  properties.  In  particular,  it  describes  that  class  which 
reflects  the  inherent  structuie  of  the  equivalent  convex  program  of  two-stage 
linear  programming  under  uncertainty  problems. 
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Boeing  Scientific  Research  Laboratories,  Document  Dl-82  0882 
(Mathematics  Research  Laboratory,  Mathematical  Note  Mo.  5", 

August;  1969. 

This  paper  is  divided  into  eight  sections.  Sections  1,  2,  and  3  are 
introductory  and  are  concerned  with  describing  the  relationship  ot  stochastic 
programming  problems  to  the  theory  of  decision  making  under  "risk"  and 
"uncertainty",  with  a  formal  statement  of  the  problem  of  "stochastic 
programming  with  fixed  recourse",  and  with  defining  an  equivalent  deterministic 
program  respectively.  The  topic  of  Section  4  is  the  set  of  feasible  solutions 
for  the  subject  program.  A  constructive  definition  of  the  feasibility  region 
is  given  and  conditions  necessary  for  the  set  of  feasible  solutions  to  be  a 
convex  polyhedral  set  (or  a  convex  set)  are  discussed.  Of  particular  import 
are  feasibility  regions  whose  lower  bounds  are  obtainable  by  a  coordinate- 
wise  investigation  cf  the  bounds  of  the  constituents  of  the  decision  vector 
and  which  In  fact  contain  the  lower  bound  defined  through  juxtaposition  of 
the  coordinate  bounds.  The  procedures  suggested  in  Section  5  for  defining 
a  set  of  feasible  solutions  for  stochastic  programs  with  fixed  recourse  are 
greatly  simplified  if  such  a  bound  exist.  In  particular,  the  cutting  plane 
algorithm  presented  reduces  to  a  relatively  simple  linear  programming  problem 
if,  in  addition,  the  set  of  points  in  the  support  of  the  program  random  variable 
is  polyhedral.  Sufficient  conditions  for  the  existence  of  such  a  lower  bound 
are  also  discussed. 

Section  6  is  short  and  defines  stochastic  programs  with  fixed  recourse 
in  which  all  vectors  feasible  for  the  first-stage  decision  are  also  feasible 
with  respect  to  the  second-stage  problem.  It  is  noted  here  that  the  problem 
of  ascertaining  feasibility  is  one  of  determining  If  a  given  convex  set  is  a 
subset  of  a  given  convex  polyhedral  cone. 
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The  objective  function  of  the  equivalent  deterministic  program  is 
investigated  in  Section  7.  It  is  shown  to  be  continuous,  convex,  and 
Lipschitz,  and,  under  appropriate  conditions,  to  be  polyhedral  and 
piecewise  linear  in  the  first-stage  decisioii  variables.  Several  related 
inequalities  are  developed  which  could  be  used  as  a  basis  for  solution 
procedures  to  define  the  extremizing  solution  vector.  These  lead  quite 
naturally  to  the  brief  discussion  of  Section  8  on  the  existence  of  primal- 
dual  pairs  of  deterministic  equivalent  programs  for  stochastic  programs 
with  fixed  recourse. 

This  article  is  a  survey  and  for  that  reason  does  assume  statements 
Che  proefs  of  which  are  left  to  the  cited  references.  Even  so,  the  discussion 
for  the  most  part  is  self-contained  and  comprehensive.  The  geometrical  mode 
of  presentation  provides  an  intuitive  basis  for  the  mathematical  statements 
given. 
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